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TITLE: SYSTEM AND IVffiTHOD FOR ROBUST OPTEiOZATION INCLUDING UNCERTAINTY* 
MODELS 



5 ' BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to the field of optimization, particularly the application of optimization 
science in the realm of strategic decision-making. 

10 

2. Description of the Related An 

Numerous approaches have been applied to the issue of strategic business decision-making, incUiding 
decision support, data mining, and optimization. 

Decision support typically utilizes technologies such as On-Linc Analytical Processing (OL.AP) and 

15 Relational On-Line Analytical Processing (ROLAP) to more systemically examine what has happened in the past. 
Witfi these approaches, a querying process may take place whereby a decision-maker may, for example, analyze all 
available data associated with transactions and customers, or a marketing manager may qucr>- a database to 
ascertain how well an offer performed with a customer segment oyer a period of time. These tools can be thought of 
as reporting applications. The dccision-maker can create custom reports and can be alerted if a query result falls out 

20 of a certain range. Performance can be measured and managed using these tooU. Although it may be useful to look 
to the past before making decisions about the future, these tools are often inadequate to help the decision-maker 
look into the future to the see the consequences of the numerous actions at his or her disposal. 

Another approach, data mining, may enable the decision-maker to look forward. Utilizing technologies 
such as neural networks and decision trees, data mining tools may be used to analyze large amounts of data and 

25 uncover patterns that lead to predictions of what future behavior a customer is likely to exhibit. The best tools in 
this category may be capable of identifying whom marketers should target based on predicted responses. However, 
the proactive prescription of what to do to meet business goals is still beyond their capabilities. It is still up to the 
manager to detenrune what action to take. 

These aforementioned approaches may help dccision-makcis gain a better understanding of their 

30 customers, but it is still the manager who must use his or her experience and inttiition to make the fmal decision of 
what to do. If managers are not careful, these tools may only push diem into making incorrect and<osriy decisions. 
These tools may not use rigorous scientific approaches to determine at what point something should be done and, 
more importantly, what should not be done. Organizations relying solely on these types of inadequate tools may 
simply become more efTicicnt at executing status quo decision-making strategies that have historicaUy been 

35 followed. 

Another approach, optimization, may address these problems at least in part Optimization may combine 
intuition and intelligence in solving strategic decision-making problems. Unlike data mining, whkrh starts with 
ii^uts and predicts an output, optimization may start with the output and seek the best actions to take to<:haQge the 
output to the con^any 's advantage. Data mining may tend to predict the future, but with optimization, the decision- 
40 maker may take actions to change Ae fiinire to the company's benefit In many business environments, the^oal of 
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optiini2aDon is to enable business decision-makers lo deiermine which-combinations and kvels of trcamients under 
dieir control should be applied. Typically, opiimization solves a dcfmed objective function, subject to one or more 
constraints, to select optimal values for one or more decision variables. Decision variables arc the parameters over 
which the decision-maker has control. For instance, in many business applications, net profit is to be maximized or. 
5 if the decisions being modeled do not impact revenues, total cost minimized 

Typically, constraints arc applied at the individual record level. These constraints may be referred to as 
local, or recor€l-level, constraints. Cross-rccord constraints, on the other hand, may balance some resource or 
measurement aaoss the entire set of records in the optimization simultaneously. Cross-record constraints limit the 
allocation of a global resource over all the records, such as budgets, total cost, etc. Applying cross-record 
1 0 constraints to an optimization problem tends to be a much more dimcult task than applying local constraints, and so 
various heuristic techniques, such as the placement of Lagrangian multipliers in the objective function, have been 
used. However, these approaches are inexact and only approximate the impact of cross-record constraints. These 
techniques may also encounter significant problems if the number of cross-record constraints grows. Exact 
techniques of applying cross-record constraints are not believed to have been appUed to customer relationship 
1 5 management or to the marketing of products to customers. 

Another approach that may be brought to bear in the optimization process is robust optimization. This 
technique may address the issue of uncertainty management by solving for the optimum solution over a variety of 
possible futures over the time frame of interest. The unccnainties dealt with may originate from a number of 
sources, inchiding environmental factors, such as the large-scale business climate, model cnors. and input data gaps 
20 or enors. The goal of robust optimization is to find an optimal or near-optimal solution, which is not overly 
sensitive to any specific reahzation of the uncertainty of the problem. It is believed that the business application of 
this technique has been primarily in the area of financial investment portfolio management and not to customer 
relationship management or the marketing of products to customers. 

Funhermore, optimization may be hampered by forecasting that ignores long-term considerations. In odier 
25 words, current approaches may not adequately reflect behaviors that do not completely, directly, and empirically 
manifest themselves, for example, in a 6 or 1 2-month period. 

For at least the foregoing reasons, there is a need for an improved system and method for optimization 
which addresses the problems discussed above and which may be applied to the area of customer relahonship 
managemenL 

30 

SUMMARY OF THE INVENTION 
The present invention provides various embodiments of a method and system for optimization of customer 
relationship management. Optimization may be used to select an optimal course of action for marketing one or 
more products to a plurality of customers. Customers may inchide current customers or prospective customers of a 
35 business. For example, customers may include credit customers to whom credit services are maricetcd. or customers 
may include pharmaceutical customers to whom pharmaceutical products arc marketed. The one or more products 
may be marketed to customers in accordance with the optimal course of action, such as through direct mailing 
and/or targeted advcrtUing. Other means of applying the optimal course of action may include, for example, 
conducting a re-pricing campaign in accordance wi(h the optimal course of action, conducting an acquisition 
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campaign in accordance with the optimal course of action, conducting an e-mailing campaign in accordance with 
the optimal course of action, and conducting a promotional campaign for customer retention in accordance with the 
optimal course of action. As will be apparent to one skilled in the ait, the system and method for optimization 
described herein may be applied to a wide variety of industries and circumstances. 
5 An optimization process may accept the following elements as input: customer information records, 

predictive model(s) such as customer model(s), one or more constraints, and an objective. The optimization process 
may produce as output an optimized set of decision variables. 

Customers may include individual customers, segments of like customers, and/or samples of customers. 
The customer information may include decision variables and extemal variables. Decision variables are those 

10 variables that the decision-maker may change to affect the outcome of the optimization process. For example, in 
the optimization of a credit card offer conducted by a credit card issuer Annual Percentage Rate (APR) and credit 
limit may be decision variables. Extemal variables are those variables that are not under the control of the decision- 
maker. For example, extemal variables may include variables such as customer addresses, customer income levels, 
customer demographic information, bureau data, transaction file data, cost of IVinds and 'capital, and other suitable 

15 variables. 

In one embodiment, the customer information including decision variables and extemal variables may be 
iwpiit into the predictive model(s) to generate the action variables. In one embodiment, the predictive models) may 
be implemented as a neural network. The neural network may be trained, for example, with historical customer 
data records as input. In one embodiment, each of the predictive model(s) may correspond to one of the customer 

20 information records. Action variables are those variables that predict a set of actions for an input set of decision and 
extemal variables. In other words, the action variables may comprise predictive metrics for customer behavior. For 
example, in the optimization of a product marketing campaign, the action variables may include the probabili^ of a 
customer*s response to an ofFcr. In the optimization of a credit card offer, the action variables may include 
predictions of balance, attrition, charge-off, purchases, payments, and other suitable behaviors for the customer of a 

25 credit card issuer. 

In one embodiment, the objective function may be a function of lifetime customer value (LCV). The 
particular function which expresses lifetime customer value may vary from optimization process to optimization 
process. Generally, LCV may include a sum of discounted cash flows over the lifetime of one or more customer 
relationships. The combination of the long-term view and short-term view may be implemented by the use of both 

30 constraint(s) and objective to embody the LCV. For example, one or more constraints may be lised to ensure that 
the budness maintains a particular level of revenue over the short term, while die objective may be used to ensure 
that the business maximizes the value of the customer relationships over the long term. Likewise, the objective may 
include short-term considerations and the constraints may include long-term considerations. 

Constraints are typically '^real-world*' limits on the decision variables. In one embodiment, the constraints 

35 include cross-record constraints. Cross-record constraints are limitations on one or more global resources as 
applied to a plurality of records. For example, a cross-record constraint may define a hmitation on a quarterly 
budget or odier finite resource that the optimization process is expected to meet. The constraints may also include 
one or more record-level constraints. A record-level constraint is a limitation that is applied to one record at a time. 
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For example, a record-tevel constraint may be a limitaiion on an interest rate offered to a customer by a credit card 
issuer. In one embodiment, ihe optimization process may use a cross-record objective. 

In one embodiment, the optimization process may employ robust optimization. Solving the objective 
function for a robust optimization process may include solving the objective function across a plurality of 
5 uncertainty models lo select the optimal solution. An uncertainty model may include any model which adds a range 
of uncertainty to an optimization process. Uncertainty models may be generated by sampling a probability 
distribution. In one embodiment, the unceitainty models may include scenarios. As used herein, "scenarios" 
include multiple sets of possible values for uncertain data or models. For example, a robust optimization process 
may use scenarios to determine an optimal solution across a range of possible models of a customer in the fiimre. 

10 The scenarios may be designed so as to span the range of possibilities likely to occur over the time frame of interest. 
In one embodiment, a method for optimization of customer relationship managemeiu may include the 
following steps. A set of customer data and/or other data corresponding to one or more customers may be collected 
and received. Given die set of customer data, one or more decision variables may be optimized based on an 
objective and one or more constraints to produce optimized decision variables. The one or more terms of a product 

15 may be set to the optimized decision variables to produce an optimized product. The optimized product may 
comprise a set of optimized terms. For example, if product is a credit card, then the optimized tcnns may include 
an optimal interest rate and credit limit. Generally, setting the decision variables of the product to the optimized 
decision variables may result in increasing the vahic of the product vendor's relationships with customers of the 
product. 

20 The optimized product may be offered to one or more of the customers. In various embodiments, the 

optimized product may be offered to cuiient and/or prospective customers in a variety of ways and tmder a variety 
of circumstances. For example, the optimized product may be offered via a direct mailing, targeted telephone 
advertising, a re-pricing campaign, e-mail, and/or a promotional campaign for customer retention. In appropriate 
cases, a response from the customer to the offering may be accepted. In various embodiments, the response may be 

25 accepted automadcally and without htunan intervention, such as through an automated on-line or web-based 
system, or fhe response may be accepted widi human intervention. In some cases, such as changing the APR of a 
credit card, for example, receiving a customer response may not be pertinent. 

The optimized terms may be carried out during a lifetime of the optimized product. In other words, the 
product vendor may maintain the customer relationship for a particular product according to the optimized temxs 

30 produced in the optimization process. Canying out the optimized terms may inchide conducting one or more 
transactions according to die optimized terms during the product lifetime. For exan^le, a credit card issuer may 
honor the interest rate and credit limit of the optimized offer for one or more credit-card transactions for as long as 
the customer holds the credit card. 

35 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an illustration of a typical computer system which is suitable for implementing various 
embodiments; 

Figure 2 is a network diagram of an illustrative distributed computing envirormieni which is suitable for 
implementing various embodiments; 
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Figure 3a is a block diagram which illusiiaics an overview of optiimzation according to one cmbodimcni; 
Figure 3b is a dataflow diagram which illusiraies an overview of optimizanon accoiding lo one 
embodiment; 

Figure 4 illustrates a single model according to one embodiment; 
5 Figure 5 illustrates multiple models for multiple products and a single customer according to one 

embodiment; 

Figure 6 illustrates multiple models for multiple customers and a single product according to one 
embodiment; 

Figure 7a is a block diagram which Ulustraies an optimization process with cross-record consirainis or a 
1 0 cross-record objective according to one embodiment; 

Figure 7b is a dataflow diagram which illustrates an optimization process with cross-record constraints or a 
cross-record objective according to one embodiment; 

Figures 8a through 8e illustrate examples of probability distributions associated with a robust optimization 
process according to one embodiment; 
1 5 Figure 9a is a block diagram which illustrates a robust optimization process according to one embodiment; 

Figure 9b is a dataflow diagram which illustrates a robust optimization process according to one 
embodiment; 

Figure 10 illustrates multiple scenario models for product-customer pairs according to one embodiment; 

Figure 11 a is a block diagram which illustrates an optimization process wth an objective function of 
20 lifetime customer value (LCV) according lo one embodiment; 

Figure 1 lb is a dataflow diagram which illustrates an optimization process with an objective function of 
lifetime customer value (LCV) according to one embodiment; 

Figure 12a is a block diagram which illustrates a robust oprimization process with cross-record 
constraints/objective and an objective function of lifetime customer value (LCV) according to one embodiment; 
25 Figure 12b is a dataflow diagram which illustrates a robust optimization process with cross-record 

constraints/objective and an objective function of lifetime customer value (LCV) according to one embodiment; 

Figure 13 is a flowchart which illustrates optimization of customer relationship management according to 
one embodiment; 

Figure 14 illustrates an off-line system architecttire for oprimization of customer relationship management 
30 according to one embodiment; 

Figure 15 illustrates an impon module for optimization of customer relationship management according to 

one enibodiment; 

Figure 16 iUustrates an export module for optimization of customer relationship management according to 
one embodiment; 

35 Figure 17 illustrates an design experiment module for optimization of customer relationship management 

according to one embodiment; . 

Figure 18 ilhisttates an experiment engine module for optinuzation of customer relationship management 

according to one embodiment; 
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Figure 19 illustrates a build componena module for oprimization of customer relationship management 

according to one embodiment; 

Figure 20 illustrates an assemble/setup conq;K>nents module for optimization of customer relationship 
management according to one embodiment; 
5 Figure 21 illustrates a manage questions sub-module for optimization of customer relationship 

management according to one embodiment; 

Figure 22 illustrates a manage optimization sub-module for optimization of customer relationship 
management according to one embodiment; 

Figure 23 illustrates a manage marginal optimization sub-module for optimization of customer relationship 
10 management according to one embodiment; 

Figure 24 illustrates a decision engine module for optimization of customer relationship management 
according to one embodiment; 

Figure 25 illustrates a decision views module for optimization of customer relationship management 
according to one embodiment; 

15 Figure 26 illustrates a decision reports module for optimization of customer relationship management 

according to one embodiment; 

Figure 27 illustrates an on-line experiment architecnire for optimization of customer relationship 
management according to one embodiment; 

Figure 28 illustrates an on-line decision architecmre for optimization of customer relationship management 
20 according to one embodiment. 

While the invention is susceptible to various modifications and alternative forms, specific embodiments 
thereof are shown by way of example in the drawings and will herein be described in detail. It should be 
understood, however, diat the drawings and detailed description diereto are not intended to limit the invention to the 
particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and 
25 alternatives falling within tfie spirit and scope of the present invention as defined by the appended claims. 

DETAILED DESCRIPTION OF SEVERAL EMBODIMENTS 

Figure 1: A Typical Computer System 

30 Figure I illustrates a typical computer system 150 which is suitable for implementing various 

embodimente. Each computer system 150 typically includes components such as a CPU 152 with an associated 
memory medium, represented by floppy disks 160. The memory medium may store program instructions for 
computer programs, wherein the program instmcrions are executable by the CPU 152. The computer system 150 
may further include a display device such as a monitor 154, an alphanumeric input device such as a keyboard 156, 

35 and a directional input device such as a mouse 158. The computer system 150 is operable to execute the computer 
programs to implement an improved optinuzation system and method as described herein. 

The conqniter system 150 preferably inchidcs a memory medium on which computer programs according to 
various embodiments may be stored. The term 'tncmoiy medium may include an installation medium, e.g., a CD- 
or floppy disks 160, a computer system incmory such as DRAM. SRAM. EDO RAM, Ra^ 
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non-voladk mcmoiy such as a magncnc media, e.g., a haid drive, or optical storage. The memory medium may include 
other types of memory as well, or combinations thereof In addition, die memory medium may be located in a first 
computer in which the programs are executed, or may be located in a second dinereni computer which connects to the 
fust con^Jutcr over a network. In die laner instance, die second computer provides die program instiucrions to die first 
5 computer for execution. Also, the computer system 150 may take various forms, including a personal computer system, 
mainframe computer system, workstation, network appliance, Internet appliance, personal digital assistant (PDA), 
television system or other device. In general, die term "computer system" can be broadly defmed to encompass any 
device having a processor which executes instructions from a memory medium. 

Tlie memory medium preferably stores a software program or programs for event-triggered transaction 
10 processing as described herein. The software program(s) may be implemented in any of various ways, including 
procedure-based techniques, component-based techniques, and/or object-oriented techniques, among odxrs. For 
example, die software program may be implemented using ActiveX controls, C+-^ objects, JavaBeans, Microsoft 
Foundation Classes (MFC), or odier technologies or metfiodologies, as desired A CPU, such as the host CPU V52, 
executing code and data from die memory medium includes a means for creating and executing the software 
1 S program or programs according to the Riediods and/or block diagrams described below. 

The con^uter system for optimization of customer relationship management as discussed herein may be a 
typical coniputer system 150 as illustrated in Figure 1 . 

Figure 2: A Distributed Computing Enviioiunent 

20 Figure 2 illustrates a disoibuted or enterprise computing environment according to one embodiment. A 

distributed computer system or enterprise 100 inchides a plurality of computer systems which arc interconnected 
through one or more nctworics. Altfiough one particular embodiment is shown in Figure 2, die distributed cwnputcr 
system 100 may include a variety of heterogeneous computer systems and networks which are interconnected in a 
variety of ways and which run a variety of software applications and/or operating system software. 

25 One or more local area networks (LANs) 104 may be included in the enterprise 100. A LAN 104 is a 

network that spans a relatively small area. Typically, a LAN 104 is confined to a single building or group of 
buildings. Each node (i.c., individual computer system or device) on a LAN 104 preferably has its own CPU witfi 
which it executes programs, and each node is also able to access data and devices anywhere on die LAN 104. The 
LAN 104 thus allows many users to share devices (e.g.. printers) as well as data stored on file servers. The LAN 

30 104 may be characterized by any of a variety of types of topology (i.e., the geometric arrangement of devices on the 
networtc), of protocols (i.e., die rules and encoding specifications for sending data, and whether the network uses a 
peer-to-peer or client^server architecture), and of media (e.g., twisted-pair wire, coaxial cables, fiber optic cables, 
radio waves). As illustrated in Figure 2, die distributed computer system 100 may include one LAN 104. However, 
in alternate configurations die distributed computer system 100 may include a plurality of LANs 104 which are 

35 coupled to one anodier dirougb a wide area network (WAN) 102. A WAN 102 is a network diat spans a relatively 
large geographical area. 

Each LAN 104 includes a plurality of interconnected computer systems and optionally one or more other 
devices: for example, one or more workstations 1 10a, one or more persona] computers 1 12a, one or more laptop or 
notebook conqniter systems 1 14, one or more server computer systems 1 16, and one or more network printers 1 1 8. 
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As illustrated in Figure 2, an example LAN 104 may include one of each of computer systems I lOa, 1 12a, 114, and 
116, and one printer 118. The LAN 104 may be coupled to other computer systems and/or other devices and'or 
. other LANs 1 04 through a WAN 102. 

One or more mainframe computer systems 120 may be coupled to the distributed computer system lOO. 
5 As shown in Figure 2, the mainframe 120 may be coupled to ihe disoibuied conrqjuter system 1 00 through the WAN 
102. but alternatively one or more mainirames 120 may be coupled to the distributed computer system 100 through 
one or more LANs 104. As shown, the mainframe 120 nrwy be coupled to a storage device or file server 124 and 
mainframe terminals 122a» 122b, and 122c. The mainframe terminals 122a, 122b, and 122c may access data stored 
in the storage device or file server 1 24 coupled to or included in the mainlrame computer system 1 20. 
1 0 The distributed computer system 100 may also include one or more computer systems which are connected 

to the distributed computer system 100 through the WAN 102: as illusn^ted, a workstation 1 10b and a personal 
computer 1 12b, In other wortis, the enterprise 100 may optionally include one or more computer systems which are 
not coupled to the distributed computer system 100 through a LAN 104. For example, the distributed computer 
system 100 may inchide computer systems which are gec^aphically remote and connecied to the distributed 
1 S computer system 1 00 through the Internet. 

Figures 3 through 6: Overview of Optimization 

As discussed herein, optimization may generally be used by a decision-maker associated wiA a business to 
select an optimal course of action or optimal course of decision. The optimal course of acdon or decision may include a 

20 seqtifrrp or combinatbn or. actions and/or decisions. For example, optimization may be used to select an optimal 
course of action for marketing one or more products to one or more customers. As used herein, a "customer" may 
include an existing customer or a prospective customer of the business. As used herein, a "customer" may include one 
or more persons, one or more organizations, or one or more business entities. As used herein, the term **product" is 
intended to include various types of goods or services, such as books, music, content subscrqynon services, furniture, 

25 online auction items, clothing, ISP service, consumer -electronics, travel, software, phaimaoeutical or medical suppUes, 
computer systons, etc., or various services such as loans (c-g., credit card, auto, mortgage, and home re-financing loans), 
securities (e.g., CDs, retirement accounts, cash management accounts, and mumal funds), or insurance (e.g., life, health, 
auto, and home owner's insurance), among others. For example, customers may include credit customers to whom 
credit services are marketed, or customers tnay include pharmaceutical customers to whom pharmaceutical products arc 

30 marketed As wiU be apparent to oiie skilled in the art, the Qrstem aiid method for optinuzation desc 
applied to a wide variety of industries and circumstances. 

Generally, a business may desire to apply the optimal course of action or optimal course of decision to one 
or more customer relationships to increase the value of customer relationships to the business. As used herein, a 
•^portfolia** includes a set of relationships between the business and a plurality of customers. In general, Ihe process 

35 of optimization may include determining which variables in a particular problem arc most predictive of a desired 
outcome, and what treatitients, actions, or mix of variables imder the decision-maker's control (i.e., decision 
variables) will optimize the specified value. The one or more products may be marketed to customers in accordance 
with Ihe optimal course of action, such as through direct mailing and/or targeted advertising. Other means of 
applying the optimal course of action may include, for example, conducting a re-pricing campaign in accordance 
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with the opiimal course of action, conducting an acquisition can^algn in accordance with the optimal course of 
action, conducting an c-mailing campaign in accordance with the optimal course of action, and conducting a 
promotional campaign in accordance with the optimal course of actioiL 

Figure 3a is a block diagram which illustrates an overview of optimization according to one embodiment. 
5 Figure 3b is a dataflow diagram which illustrates an overx iew of optimization according to one embodiment. As 
shown in Figure 3a, an optimization process 200 nrjay accept the following elements as input: customer information 
records 202, predictive raodel(s) such as customer modeKs) 204, one or more constraints 206, and an objective 208. 
The optimization process 200 may produce as output an optimized set of decision variables 210. In one 
eiiibodiment, each of the customer model(s) 204 may correspond to one of the customer infora:iation records 202. 

1 0 As used herein, an "objective'' may include a goal or desired outcome of an optimization process. 

As used herein, a ""constraint" may include a limitation on the outcome of an optimization process. 
Constraints arc typically "real-world" limits on the decision variables and are often critical to the feasibilil>' of any 
optimization solution. Managers who control resources and capital or arc responsible for fmancial effects should be 
involved in setting constraints that accurately represent their real-world environments. 'Setting -constraincs with 

1 5 management input may realistically restrict the allowable values for the decision variables. 

In many applications of the optimization process 200. the number of customers involved in the 
optimization process 200 may be so large that treating the customers individually is computationaUy unfeasible. In 
these cases, it may be useful to group like customers together in segments. If segmented properly, the customers 
belonging to a given segment will typically have approximately the same response in the action variables to a given 

20 change in decision variables and external variables. For exanq>le, customers may be placed into particular segments 
based on particular customer attributes such as risk level, fmancial stams, or other demographic information. Each 
customer segment may be thought of as an average customer for a particular type or profile. A segment model, 
which represents a segment of customers, may be used as described above with reference to a customer model 204 
to generate the action variables for that segment. Another alternative to treating customers individuaUy is to sample 

25 a larger pool of customers. Therefore, as used herein, a ^'customer" may include an individual ^customer, a segment 
of like customers, and/or a sanq>le of customers. As used herein, a "customer model" "predictive model", or 
**modcr may inchide segment models, models for individual customers, and/or models used wth samples of 
customers. 

The customer information 202 may include decision variables 214 and external variables 212. As used 
30 herein, ^'decision variables" are those variables that the decision-maker may change to affect the outcome of the 
optimization process 200. For example, in the optimization of a credit card offer conducted by a<redit card issuer, 
Annual Percentage Rate (APR) and credit limit may be decision variables. As used herein, "external variables" are 
those variables that are not imder the control of die decision-maker. In other words, the external variables arc not 
changed in the decision process but rather arc taken as givens. For example, external variables may include 
35 variables such as customer addresses, customer income levels, customer demographic information, bureau data, 
transaction file data, cost of funds and capital, and other suitable variables. 

In one embodiment, the customer information 202 including decision variables 214 and external variables 
212 may be input into the predictive model(s) 216 to generate the action variables 218. In one embodiment, each 
of the predictive model(s) 216 may correspond to one of the customer information records 202, wherein each of the 
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customer infonnauoo records 202 may include appropriate decision variables 214 and «xcemal variables 212. As 
used herein, "action vanables" are those variables that predict a set of actions for an input set of decision and 
external variables. In other words, the action variables may comprise predictive metrics for customer behavior. For 
example, in the optimization of a product marketing campaign* the action variables may include the probability of a 
5 customer's response to an offer. In a rc-pricing campaign, the action variables may include the likelihood of a 
customer maintaining a service after re-pricing the service. In the optimization of a credit -card offer, the action 
variables may include predictions of balance, attrition, charge-off, purchases, payments, and other suitable 
behaviors for the customer of a credit card issuer. 

The predictive model(s) 216 may include the customer mode](s) 204 as well as other modcb. The 
1 0 predictive model(s) 216 may take any of several forms, including, but not limited to: trained ncumi nets, statistical 
models, analytic models, and any other suitable models for generating predictive metrics. The models may toke 
various forms includixig linear or non-linear, such as a neural network, and may be derived from empirical data or 
from managerial judgment. 

In one embodiment, the predictive nnodel(s) 216 may be implemented as a neural network. Typically, the 
1 5 neural network may include a layer of input nodes, interconnected to a layer of hidden nodes, which arc in turn 
intercoiuiected to a layer of output nodes, wherein each coimection is associated with an adjustable weight whose 
value is set in the training phase of the model. The neural network may be nained, for example, with historical 
customer data records as input. The trained network may include a non-linear mapping function that may be used 
CO model customer behaviors and provide predictive customer models in the optimization system. The trained 
20 neural network may generate action variables 21S based on customer information 202 such as external variables 
212 and decision variables 214. 

In one embodiment, a model comprises a representation that allows prediction of action variables, a, due to ^ 
various decision variables, d, and external variables, e. Figure 4 illustrates a model 215 with external variables 212. 
decision variables 214, and resulting action variables 218. For example, a customer may be modeled to predict 
25 customer response to various offers under various circumstances. It may be said that the action variables, a, are a 
function, via the model, of the decision and external variables, d and e, such that: 

wherein A/() is the model, a, is the vector of action variables, d is die vector of decision variables, and e is the vector 

30 of external variables. 

In one embodiment, die action variables 218 generated by the model(s) 216 may be used to formulate 
constrautt(s) 206 and the Objective function 208 via formulas. In Figure 3b, a data calculator 220 generates <he 
constraint(s) and objective 222 using the action variables 218 and potentially other data and variables. In one 
embodiment, the formulas used to formulate the constraint(s) and objective 222 may inchide fmancial formulas 

35 such as formulas for determining net operating income over a certain time period The con5traint(s) and objective 
222 may be input into an optimizer 224, which may comprise, for example, a ciistom*designed process or a 
cotrutiercially available "off the sheir product. The optimizer may then generate the optimal decision variables 210 
which have values optimized for the goal specified by the objective function 208 and subject to the constraint(s) 
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206. The opomization process 200 carried out by the oprimizer 224 is discussed in greater detail below. A fiifther 
understanding of the optimization process 200 may be gained from the references -An Introduction to Management 
Science: Quantitative Approaches to Decision Making", by David R. Anderson, Dennis J. Sweeney, and Thomas 
A. Williams. West Publishing Co. (1991); and "Fundamentals of Management-Science- by Efraim Turban and Jack 
R. Meredith. Business Publications, Inc. ( 1 988). 

Overview of Optimization for a Single Customer 

Many optimization probtems have the following form: given a model of a customer or segment 
a » M{d,e). a set of objective parameters o. a set of constraint parameters Cp, and a set of constraint bounds t*. 
use an oprimizer to compute the set of decision variables for a customer or segment diat exiremizes (e.g., maximizes 
or minimizes) an objective function of the form: 

J = f{d,e.a,o) 

subject to the model constraint: 

and a general set of constraints of the form: 

0<g(rf.€.fl,cJ<C, 
wherein the decision variables d, arc a subset of the set of possible decision variables. D. 

There arc a number of approaches for solving optimization problems of this form. As is well known by 
those skilled in Ac art. the approach selected depends on the foim of the model, of the objective function, of the 
constraints, and of the set of possible decision variables. The model, objective function, and-constraints may each 
be eidier linear (L) or non-linear (NL). The decision variable set, may be a linearly bounded single region 
(simple convex area) (L), a non-linear bounded single region (NL). multiple regions (MR), or discrete. C:ommcrcial 
solvers, or oprimizers, are available for solving all combinations of linear and non-linear con^onents for single 
region decision variable sets. For the cases when variables are not restricted to a single continuous region, a variety 
of other, more heuristic, approaches are generally available. Several of these approaches solving optimization 
problems are discussed in greater detail as follows. 

Example of Optimization with Linear Programming 

A simple credit card offer optimization problem fliustrates the LP approach. The model -con^Miies the 
rcqwnse rate to a maUed offer and expected monthly balance of a responder; therefore, the action variables arc: a, 
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= response rate; « expected balance. The decision variables Tor the offer arc annual percentage rate (APR) and 
credit limit; ihus, d, « APR; rfj credit limit. Thcic are no external variables in this example. 



A linear model of the form: 

5 

a, = w,,rf, + Wijrf, +6, 

may be used, wherein w„, 6|, »v^/. w.v, and b; are parameters of the model. The parameters may be found, for 
example, using linear regression techniques based upon hbtorical data. 

1 0 The objective function, J, to be maximi2ed, also linear, is of the form: 

J = o,a, (5) 

wherein o, is an optimization parameter. Using this objective function, at and ay may be maximized. The relative 
importance of ai versus aj is determined by the optimization parameter, O/, which is specified by the user. 

A linear constraint is of the foim: 
and the set of possible decision variables, />, is restricted such ihat: 
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.05 <d, <A9 



1,000 <rf2 < 5,000 



(range of APR) (7) 
(range of credit limit) (8) 



Because the model, objective function, constraint, and set of decision variables are linear, this example can 
be solved using standard linear programming techniques. 

-25 Example of Optimization with Non-Linear Programming 

In a further example, the objective, constraints, and set of decision variables are of the form shown above, 
and the model is implemented by a non-linear neural network: 

fl = A/(rf,e) = AW(rf,e,w) W 
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whciein w is the vector of weight parameters of the neural network which may be identified using historical data 
and the back propagation method of neural network training. In this case, because the model is non-linear. a non- 
linear commercial solvcr/oprimizer may be used to solve for the decision variables. 

5 Overview of Optimization with Heuristic Linear Programming 

A similar problem may be considered, but with the set of possible decision variables restricted to a discrete 

set, such as: 



[rf'J ^ ([loooJiiooojlzsooj'isooo]] 



(10) 



10 such iat the APR values of each of the four offers are 5%. 9%. 12.5%. and 19%. respectively, and the credit limits 
are $1000. SIOOO, $2500, and $5000, respectively. Because the problem is non-linear and discrete, a mixed integer 
Unear programming (MILP) approach may be used; however, by reformulating d>e problem heuristically, a linear 
programming (LP) technique may be used instead. This is referred to as a heuristic LP approach. 

15 The above pioblcm may be reformulated by enumerating the solutions. e.g.. by -coniputing the ouiput of 

the neural network model for each element of the set: 



2. 



; {NN(.05,\ 000).AW(.094000),MV(. 125,2500). AW(.19;5000)) = 



(H) 



wherein the ouiput corresponding to the first element of the set is j^^" j . The objective function. J. may then be 
20 rewritten to select die optimal pair of action variables: 

maxy =«,(<7,o„ +a2,)+n2(«2«i2 + "Tzh "iiojOtt +«»)+ "4(04014 +034) 
wherein n,. are selection variables constrained by: 
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(14) 

and wherein: 

(6) 

5 At this point, a conventional linear programming technique may be used because ihe selection variables n, 

are optimized, rather than the decision variables, and because n, appear linearly. Once the optimal setecUon 
variables are computed, one of the n, will be equal to 1 , with the rest equal to 0. assuming only one maximum in 
Ihe set. The optimal decision variables of ihe set correspond to the n, equal to I. Thus, the decision variables are 
computed using a heuristic LP approach. Tliis technique may generally be used when die set of discrete decision 
10 variables is finite. 

Overview of Optimization for Multiple Products or Multipl e Customers 

In the cases where multiple products may be offered to a single customer, or where a single product may 
be offered to multiple customers, a different model may be used for each product/customer pair, for example, in 
15 the case of a single customer being offered multiple products, the modek may be defined as foUows: 

a, =j»/(rf„e,).Oj =M(</„ej)....;a„=ii/<d,,c<„) ^'^^ 

with a set of Boolean selection variables: 

5 = (5,,Jj,...5„) ^^^^ 

that may be used to select which offers to make to the customer. iFigure 5 ilhistrates the muWple product models of 
expression (15). 



In a similar way, for Ae case of a single product being offered to multiple custonxrs. Ae models may be 
25 defined as follows: 

a, =M(</,,e,), flj =M(i/j,c,) fl^ =M{d^,e^) 
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with a set of Boolean selection variables: 
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(18) 

Figure 6 illustrates these multiple customer models. Optimization with multiple customer models is mathematkany 
equivalent to optimization with multiple product models. 

Given the above set of models for various products M e (Af , , A/, ,..„M^ ) for a customer <i.e.. an 
individual customer, customer segment, or customer sample), a set of objective parameters o. a set of constraint 
parameters Cp, a set of constraint bounds c*, and an objective function of the form: 



which is subject to the model constraints: 

a, =M(d,,e,), a.^M(d^,e^) a„ zzM{d„,e„) 

and a general set of constraints of the form : 

and the set of possible decision variables, D, and selection variables, 5, such that: 

dBD 

seS 



(19) 



(rs) 



(20) 



(21) 



dicn an optimizer may generally be used to compute the decUion variables for a customer to extrcmize the objective 
function, 7. 

Figure 7: Optimization with Ooss-Record Constraints 

Figure 7a is a block diagram which illustrates an optimization process 200 with cross-record constraints 
according to one embodiment. Figure 7b is a dataflow diagram which illustrates an optimization process 200 with 
cross-record constraints according to one embodiment. In one embodiment, the constraint(s) 252 may include one 
or more cross-record constraint(s), and the optimizer 224 may solve the objective 208 subject to the cross-recocd 
constraint(s) 252. As used herein, a "cross-record conswaint" is a linutation on one or more global resources as 
applied to a plurality of records such as customer infomaation records 202, For example, a cross-record -constraint 
may define a limitation on a quarterly budget or other finite resource that the optimization process 200 is expected 

15 
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to meet. The constraint(s) 252 may also include one or more rccord-lcv€l constraints. As used herein, a;'rccord- 
level constraint" is a limiution that is applied to one record at a time. For example, a record-level constraint may be 
a limitation on an interest rate ofTercd to a customer by a credit card issuer. 

The optimization process 200 may also be solved subject to limitations on global resources by using a 
cross-record objective function 209. Therefore, the data calculator 220 may generate cross-record consCTaint(s) 
and/or cross-record objective 254 for use by the optimizer 224. An objective function is a cross-record objective 
function if it cannot be wrinen as a sum of individual record objectives: 

J = f{d,,e,,a^yS^,d2.e^.aj,52,>..d^,e„,a^,s„,o)^ ^^^^ 

An example of such an objective might be die profit for a collection of product offers. 

Figures 8 through 10: Robust Optimization 

Figure 9a is a block diagram which illustrates a robust optimization process according to one embodiment. 
Figure 9b is a dataflow diagram which iUustrates a robust optimization process according to one embodiment. 
Generally, robust optimization includes constrained optimization across a plurality of uncertainty models 260. In 
other words, solving the objective function in robust optimization may include solving the objective function across 
a plurality of uncertainty models 260 to select the optimal solution, given the uncertainty provided by the 
uncertainty models 260. As used herein, an 'Hinccrtainty model" may include any model which adds a range of 
uncertainty to an optimization process. "Robust optimization" is generally synonymous with stochastic or 
probabilistic robust optimizanon. 

In a detenninistic model, a change in decision variables or .external variables results in exactly (i.e., 
dcterministicaDy) the same change in the resulting action variables. Thus, a detciminislic model /(.) may be 
expressed as follows: 

a = f(d,e) 

In a nondetetministic or uncertainty model, a change in decision variables or external variables may not 
result in exactly the same change in the resulting action variables. In this case, die action variables may be 
represented by a probability distribution: 

Pia\d,e) ^^'^ 

The model (24) is the probability distribution of the action variables, a, given the decision and^xtemal variables, d 
and e. In a preferred embodiment, robust optimization uses a nondetetministic or uncertainty model for a 
customer/segment, as shovm in expression (24), rather than a deterministic model. 
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In many cases, the diieci probability disnribunon cannot be used in the optiinization pioblem, either 
because the distribution cannot be computed in a reasonable time or the optimization problem cannot be computed 
in a reasonable time. In these cases, samples of the distribution may be used to solve or approximate the solution to 
the problem. Sampling is illusuaied by the following simple problem. The expected value of a distribution, /(x), 
can be approximated by drawing random samples from^x). Thus: 

, A (25) 
E(x)=ixf(x)dx = —X', 

wherein x, are the independent samples of y(x). The independent samples are known as scenarios. By 
independently sampling the probability distribution p(a\d,e), a set of scenario models 
{^2, ^Aid,e),a^ = f^{d,elK,a^ ^ f^id.e)} may be generated. The scenario modeb may then be used 
to approximate the robust optimization solution. The solution may be determined as shown above for multiple 
models. 

Bayes* Rule allows us to express the probability distribution (24) as: 

pia\d.e)^pid,^a)p^{a) ^^^^ 



wherein pfXa) is known as the prior distribution and is normalized. By assuming a prior distribudon, p{a) , die 
probability distribution may be approximated as: 

pia\d,e)^pid,^a)p(a) ^^^^ 

In general, it is easier to sample pid,^a) than pia\d,e) Thus, sampling of p(d,e\a) may be used 
in many cases. Sampling models and optimization approaches using this technique are further discussed in a patent 
application entitled "Bayesian Neural Networic for Optimization" by E. Hartman and C Peterson,'S/N 09^90,791, 
filed 4/12799, which is incorporated herein by reference, as though fully and conipletely set forth herein. 

A second approach to sampling Ihe disuibution, /7(a|t/,e), is realized by: 

pia\d.e) = f,yEid,e)'^pir\d,e) ^^^^ 
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wherein f^,e^d,e) is a detetiniiiistic function represeoiing the average of the distribution. p(a\d,e). and 
wherein p(r|</.e) is the residual distribution. In this case, the residual distribution is sampled rather than the 
acnial distribution. 



It is common to train a neural network to represent 

Furthermore, it may be assumed that p(r\i,e) is independent of d, e. Thus: 

p(r|£/,e) = /»(r) 



(29) 



(30) 



and 



p(a\d,e) = NN^ycid,e) + p{r) 



(31) 



Given an historical dataset. D. the NNave can be developed. The historical dataset can also be used to 
determine the distribution of die lesiduab. hi diis case, die distribution is dependent on the historical data, and dius: 

is the distribution. This results in the model: 

p{a\i.e)BNN^y^(d,e) + p(r\D) ^^^^ 

One forni of the distribution for p(r^) is a normal distribution with zero mean Ni<7\D) , as iUustratcd 
in Figure 8a. and wherein a is the standard deviation. Given the residuals, for the historical dataset A tht standard 
deviation may be computed, giving the model: 

pia\d,e) 5 NN^yrXd.e) + N{a\D) ^'^^^ 

It is straightforward to sample this distribution and create scenario models. 
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Another distribution is the symmetric triangle distribution Hw) shown in Figure 8b, wherein w is the 
width. The residual data may be used to detemiine u- for the distribution: 

/>(fl|rf,e)£AW,^^(rf,c) + r(HjZ>) 

5 The distributions may be sampled, yielding models of the form: 

M ^^^^ 

wherein rn, . . are samples of p(r\D) . 

10 Because events of the ftmirc may differ from the past, the user may override the historical «Uta and use his 

or her best judgment to select an appropriate distribution. Robust optimization may therefore be enhanced by 
management judgment. For example, consider the triangle distribution expressed as disoibution (35), or by 
aj^lying Bayes' Rule: 
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p(fl|rf. e) s NN.y, e) + nD\w)TM ^^^^ 



The user may select an appropriate prior distribution for T^w). Often, a broad Gaussian distribution may 
be selected, as shown in Figure 8c. However, the user may feel that the world is too uncertain to trust the historical 
data as a guide to fiinirc events. Therefore, the user can select a prior distribution with a high value for w to 
represent a region of higher uncertainty, as shown in Figure 8d. The user may also select the distribution shown in 
20 Figure 8e, resulting in die following model: 

By setting the prior disttibunon in this way, management judgment can be taken into account in the 
probability models and thus in robust optimization. 
25 In one embodiment, the uncertainty models 260 may include scenarios as discussed above. As used 

herein, "scenarios" include multiple sets of possible values for uncertain data. Scenarios may express a range of 
uncertainty in the future. The scenarios may be designed so as to span the range of possibilities likely to occur over 
the time frame of interest. In this way, the decision-maker may measure the consequences of environmental 
uncertainty, model enors, gaps or errors in input data, or errors experienced in predicted and forecasted behaviors 
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or other business parameters thai impact his or her decision metric, and in doing so. determine his or her strategy 
based upon the desired level of risk. 

As shown in Figure 10, multiple scenarios may be represented by multiple models for a producl- 

customer/segment pair: 



a, =A/(rf,,e,), A/ (rfj.Cj )...., flj, ==A/(d^,^j,) 



(39) 



The notation is similar to that for multiple products/customers as discussed with reference to Figures 5 and 6,«xcept 
that instead of Boolean selection variables, weights may be used to weight the irrn>ortance or likelihood of one 
model against another. A probability may be assigned to each scenario to denote its likelihood of occuncncc. 
10 These probabilities may be used to weight the contributions of each record s consnaini and objective calculations, 
therefore allowing the decision-maker to assess the consequences of strategic decisions in the light of the relative 
associated risks. 

In one embodiment, the plurality of uncertainty models 260 may be generated by varying a set of action 
variables 218 to represent varying circumstances of possible futures. Uncertainty models may be used to vary the 

IS values of the action variables 218 according to (I) some set of empirical distributions (one or more distributions per 
action variable) or to (2) some set of distributions derived through managerial judgment or to (3) some combination 
of empirically derived and judgmentally derived distributions. The objective function may be a tunction of the 
action variables 218 across a plurality of uncertainty models 260. 

In another embodiment, probabilities arc not assigned to die scenarios; rather, a decision table may be 

20 used in conjunction with any of a number of well-established methods, such as Equally Likely Criterion. Maximax 
Criterion, Maximin Criterion. Hurwicz Criterion of Realism, or Minimax Regret, as wiU be familiar to those skilled 
in the art. A greater understanding of these established methods may be gained by referring to an elemenury text 
on Management Science or Decision Analysis such as "Spreadsheet Modeling and Decision Analysis: A Practical 
Inttoduction to Management Scicnce^ Qiff T. Ragsdalc. Course Technology Inc. (1997). 

25 

Figure 11: Optimization of Lifetime Customer Vahie 

In die past, businesses typically focused dieir predictive modeling and even dieir optimization on die near 

term. Short-term considerations, such as Net Operating Income (NOl) or quarteriy profitability, aic often useful; 

however, it may be even more useful to enable decision-makers to project much further into die future, so diat 
30 bchaviois diat do not completely manifest in a 6 or 12-mondi period may stiU be fuUy considered in the 

optimization process 200. Long-term forecasting may enable die manager to make decisions widi a strategic focus. 

Integrated modeling and forecasting may enable die manager to balance short-term and long-teim concerns to 

determine which decisions provide the most value to die business. 

Figure 1 la is a block diagram which illustrates an optimization process 200 widi an objective function of 
35 lifetime customer value (LCV) according to one embodiment Figure lib is a dataflow di^am which illustrates an 

optimization process 200 widi an objective function of lifetime customer value according to one embodiment As 

discussed above, die mediod and system for optimization may be applied to select an optimal course of action for 

marketing products to die plurality of customers, in one embodiment, die objective function 230 may include 



20 



wo 01/55939 PCTAJSOl/02880 
considerations of lifciimc customer value. In other words, the objective function may be a funcuon of LCV. In one 
cmbodimem. the LCV may be implemenied through the use of constraints 235 in addition to the use of the objective 
. function. 

The particular funclion which expresses lifetime customer value may vary from t^timization process to 
optimization process. For example. LCV may be calculated differendy for a particular credit card btfer 
optimization than for a particular pharmaceutical offer optimization. Generally, LCV may include a sum of 
discounted cash flows over time. In one embodiment, in other words, the basic foitn of LCV is as follows: 



_ y (Net facome After Tax J) 
V 0 + Discount Rate)' 



(40) 



10 wherein Net Income Af^er Tax J (NL\T) is a dificrence of cash inflows and -cash outflows for a rime period 'V. 
Cash inflows for time period may include, for example, sales income, fee income, and interest inconie. Cash 
ouflows for a time period "t" may include, for example, chargc-off expense, cost of funds, and marketing cost. Net 
Income After Tax J is therefore discounted and summed over the entire post-trcamient period. In rfiis way, the 
value tfiat each customer in the portfolio will provide to the organization over the lifetime of the relationship may be 

15 found. 

LCV may include a long-term view and a short-term view of the customer relationship(s). As used herein, 
a "long-term view" includes a period of one or more years. The combination of die long-term view and short-term 
view may be implemented by die use of both consttrainl(s) and objective to embody the LCV. For example, one or 
more constraints may be used to ensure that the business maintains a particular level of revenue over the short term. 

20 while the objective may be used to ensure that the business maximizes die value of die customer relationships over 
the long term. Likewise, the objective may include short-term considerations and the constraints may include long- 
term considerations. Various combinations of die objective, constraints, short-term considerations, and long-term 
considerations may be used to arrive at an appropriate LCV function for a particular optimization process 200. 

In one embodiment, as shown in Figure 1 lb, die action variables 219 over the Ufetime of die relationship 

25 may be received as input to a data calculator such as a cash flow calculator 232. The cash flow calculator 232 may 
include a set of financial formulas that are used to calculate the constraint function(s) and the objective function 
including LCV 234 for each input data set of die external variables 212 and decision variables 214. In one 
embodiment, the cash flow calcuUtor 232 may calculate a series of pcr-customcr LCV values c,/ for a given 
segment i, offer J, and scenario s, where die pcr-customer LCV is a function of the action variables o/ for a given 

30 customer/segment i, offer J, and scenario s: 

c,'^LCV(a,') ^^'^ 

The cash flow calculator 232 may measure all die cash inflows and outflows required by the objective 
function and constraints 234. The cash flow calculator 232 may caknilaie inflows and outflows from model 
35 predictions and forecasts of account behavior as well as from odier data avaOable to die decision-maker. Ingoing 
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so, the cash flow calculator 232 may convcn available data into a scries of detailed and customizable cash flows at 
particular lime intervals (e.g., monthly, quanerly* bi-annually or annually). Cash inflows and outflows may also 
facilitate the calculation of '*tcrminal value ' Individual cash flows n»y be calculated at the most granular or 
detailed level with respect to the different individual components that comprise all flows of cash. Individual cash 
5 flows may be discounted and may ultimately fomn the LCV expression that is the objective function 230 of the 
optimization analysis. 

Figure 12: Robust Optimizarion of Lifetime Customer Value with Cross-Record Constraints and/or Cross-Record 
Obfective 

10 Figure I2a is a block diagram which illustrates a robust optimization problem with-cross-record<:onstrainis 

and an objective function of lifetime customer value (LCV) according to one embodiment. Figure 12b is a dataflow 
diagram which illustrates a robust optimization problem with cross-record constraints and an objective function of 
lifetime customer value (LCV) according lo one embodiment. In other words, the approaches discussed with 
reference to Figures 3 through 1 1 may be practiced together according to one embodiment. 

15 As shown in Figure 12a, an optimization process ^00 may accept the following elements as input: 

customer information records 202, customer model(s) 204, uncertainty model(s) 260, one or more constraints 271. 
and an objective 231. The constraint(s) 271 and/or objective 231 may include LCV. The . constraints 271 and/or 
objective 231 may be cross-record. The optimization process 200 may produce as output an optimized set of 
decision variables 210. 

20 As shown in Figure 12b, the customer infomnation 202 including decision variables 214 and external 

variables 212 may be input into the predictive model(s) 216 to generate the action variables 219 over the lifetime of 
the custontcr relationship. The predictive model(s) 216 may include the customer modeKs) 204 and uncertainty 
model(s) 262. A data calculator such as a cash flow calculator 232 may include a set of financial formulas that are 
used to calculate the constraint &uiction(s) and the objective function including LCV and cross-record -constraints 

25 and/or cross-record objective 270. An optimizer 210 may dien produce an optimized set of decision variables 2 10 
which tnay be applied by die business to increase the value of customer relationships. 

In the case of multiple customers with multiple products across multiple scenarios, a large number of 
models may be required. This population of models may be thought of as forming a cube of models, with the three 
axes representing customers/segments, products, and scenarios, respectively. For example, for a problem with 10 

30 customers/segments, 10 products, and 20 scenarios, 2,000 modeb may be required. The form of Ae optimization 
for ttiese problems is also generally the same as that for multiple customers/products. Therefore, in one 
embodiment, the multiple models may be included in the objective and constraints. Depending on the final form of 
the objective and constraints, the appropriate optimization technique may be selected, as discussed with reference to 
Figures 3 through 6. 
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Example 1: Linear ProgramminR Formulation without Scenario Probabilities 

An example of robust optimization (RO) of LCV with a cross<record constraiot of Net Operating Income 
(NOl) is given as follows. In expressions (42) dirough (44), d are decision variables, are decision variables for 
segment i given offer J under scenario j, e are external variables, are external variables for segment t^given offer 
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j under scenario « arc acrion variables, a^^ are action variables for segment i .given offery under scenario o are 
objective parameters (such as penalty weights or objective coelTtcients), is the number of customers (i.e.. current 
customeis or prospective customers) in segment i who get offery, C// is LCV per customer for segment / given offer 
y under scenario Ny* is NOI per customer in segment i given offery under scenario 5. N, is an NOI requirement for 
time period and Ay is the admissibility of offer J in segment i under scenario s {A J = 1 if admissible; A^^ = 0 
otherwise). As discussed with reference to Figure 6, = LCViOy)^ This formulation has multiple scenarios 
such that one of the RO decision criteria discussed above could be applied to find the RO solution: 



(42) 



$uchthat5]5]^^M5-^' for all 5. r ^^^^ 

i J 



This is a typical constraint which shows that in each scenario 5 and in each time period r, the total amount 
of near-term revenue (expressed here as Net Operating Income) must exceed some threshold value A similar 
constraint could keep losses below a given threshold. In fact, almost any resource may be constrained. 

This formulation may be converted into a Linear Program (LP) by imroducing the scalar variable y. In the 
1 5 formulation shown as expression (44), each scenario above becomes one constraint, and the variable y becomes die 
objective value of the LP. This LP gives the Maximin RO solution. The scenarios do not have probabilities. 

y such that XZ< ''i; 4^>' for all 



max over 



» J 

ZH^M ^^' foralls,t 

i J 



Example 2: Linear Programming Formulation with Scenario Probabilities 

20 An example of robust optimization (RO) of LCV with "soft" cross-record constraints of minimum Net 

Operating Income (NOI) and maximum first-year loss, using slack variables, is given as follows. In expressions 
(45) through (49). p, is the probability that scenario s occurs. E(.) is mathematical expectation (i.e., expected value), 
Wkisz weighting factor for constraint A, m// is negative deviation in scenario s from meeting constraint k, ndk is die 
negative deviation across all scenarios, pdk' is positive deviation in scenario s from meeting consnaint d are 

25 decision variables, d^ are decision variables for segment i given offer^ under scenario j, e are eternal variables, V 
arc external variables for segment 1 given offer j under scenario a are action variables, a^^ arc action variables for 
segment 1 given offer J under scenario o arc objective parameters (such as penalty weights or objective 
ccefncients), is the number of customers (i.e., current customers or piospecdve customers) in segment 1 who^get 
offer 7, n, is the number of accounts represented by record / (i.e., in that microsegment), c^,* is LCV per customer for 

30 segment i given offer j under scenario j. N^* is NOI per customer in segment i given offer/ under scenario *, is 
NOI requirement number V firet-ycar losses P« customer in segment 1 given offery under scenario Lk is 
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fiisi-year loss requirement number *. Ay' is the admissibilily of offer y in segment i under scenario s {Ag' = 1 if 
admissible; Ay' - 0 otherwise). mdAeis the admissibility of offerj in segment i under all scenarios. As discussed 
with reference to Figure 6. = LCVia^'). In this example, the LP formuhition for maximizing the expected 
vahK of LCV is as follows: 



5 



max J = f(d,e,a,o) = XZ^^^ff)"?^ " 



(43) 



such that 



ZZ^^''*^ =N,+pdi-ndl for*-landanj 



i J 



"^^L'^n.A^^L^-pdlfnd', for*-2andalU 



(46) 



(47) 



I J 
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As aqmxed in scenario constraint (46). in each scenario s, in each time period *. the expected NOl must nteet the 
NOI goal Ni. As expressed in scenario constraint (47), in each scenario s, the expected first-year losses must meet 
(iKM exceed) the loss goal L*. 

^ <48) 



As expressed in recotd/segmem constraint (48), the total number of offers given whhin microsegment i must equal 
the number of accounts in the microsegment. As expnssed in record/segment constraint (49). the number of 
inadmissible offers must be zero. 

20 

The objective function written with scenario probabUities may therefore be expressed as follows: 

(50) 

max 



The objective function (50) may take several forms. It may use some function <T to reflect Ae tradeoffs 
25 among the scenarios. Forexan^ile: 
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a(fi>„<a„.".<»,) = X^*^' 

s 
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(5t) 



(52) 

S 

<T(€y„iy2, ■•fi^,) ^ min, ^^^^ 

The expected value approach (51) is often called Stochasiic Linear Programming. Problems with this form 
5 of the objective arc die easiest to solve since they arc linear, but are not always appropriate to a given problem. 
Such an objective implies risk neutrality on die part of die decision-maker. The utility function approach (52) 
allows die risk toleiance of die decision maker to be modeled explicitly, which is better for risk averse decision 
making, unless die LCV of die objective function have already been adjusted to account for risk. The utility 
function in the objective necessitates nonlinear optimization techniques. Finally, die Maximin formulation of die 
10 objective function (53) fmds values for die decision variables that maximize LCV in die worst-case scenario. An 
alternate fomiulation is to maximize near-temi profit while placing constraints on Expected LCV. The Maximin 
formulation may be appropriate when die decision-maker's risk aversion is strong. By selecting an appropriate 
foimulanon, a robust optimization problem may be solved in accordance widi a customcr*s attitude regarding risk. 



15 Figure 13: Optimization of Customer Relationship Management 

Figure 13 is a flowchart which illustrates optimization of customer relationship management according to 
one embodiment. In step 302, a set of customer data corresponding to one or more customers may be collected and 
received. As discussed above, die customer data may include external variables and decision variables. In step 
304, given die set of customer data collected in step 302. one or more decision variables may be optimized based on 

20 an objective and one or more constraints to produce optimized decision variables for a product offer. Step 304 may 
lurdier include inputting die set of customer data from step 302 into one or more predictive models to generate one 
or more predictive customer behaviors (i.e.. action variables). In one embodiment, the one or more predictive 
models may comprise a neural network. Step 304 is discussed in greater detail widi reference to Figures 3 dirough 
12. 

25 As discussed above widi reference to Figure 1 1 , in one embodiment, die objective and/or ^onsoraints may 

comprise a lifetime customer vahie function. The lifetime customer value function may comprise a sum of 
expected cash flows over die lifetime of a relationship widi die customer. The lifetime customer value function 
may represent a long-term view and a short-term view of die customer relationship. In one embodiment, a long- 
term view is a period of two or more years. 

30 In one embodiment, optimizing die decision variables may ftmher include optimizing die decision 

variables across a plurality of uncertainty models. As discussed in greater detail widi reference to Figures 8 through 
10. in one embodiment, die uncertainty models may comprise scenarios. The uncertainty models may be •generated, 
for example, by varying a set of external variables to represent varying circumstances of possible tutures. 
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In one embodiment, the constrainis may include record-level constraints and/or cross-record constraints. 
Cross-record constraints include limitations on global resources. In one embodiment, the objective may be a cross- 
record objective. Cross-record constraints and objecrivcs arc discussed in greater detail with reference to figure 7. 

In step 306, the one or more teims of a product may be set to the optimized decision variables to produce 
5 an optimized product. ITie optimized product may comprise a set of optimized terms. For example, if product is a 
credit card, then the optimized tenms may inchide an optimal interest rate and credit limit. Generally, setting the 
decision variables of the product to the optimized decision variables may result in increasing the value of the 
product vendor's relationships with customers of the product. 

In step 308, the optimized product may be offered to one or more of the customers, in various 
10 embodiments, the optimized product may be offered to current and/or prospecrive customers in a variety of ways 
and under a variety of circumstances. For example, the optimized product may be offered via a direct mailing, 
targeted advertising, a re-pricing campaign, e-mail, and/or a promotional campaign for-customer retention. 

in step 310, a response from the customer to die offering may be accepted. In various embodiments, the 
response may be accepted automatically and widiout human intervention, such as through an automated on-line or 
15 web-based system, or the response may be accepted with human intervention. 

In step 312, die optimized terms may be carried out during a lifetime of die optimized product. In odier 
words, the offeror or product vendor may maintain die customer relationship in step 312 Tor a particular product 
according to the optimized terms produced in die optimization process of step 304. Carrying out die optimized 
terms may include conducting one or more transactions according to die optimized terms during die product 
20 lifetime. For example, a credit card issuer may honor die interest rate and credit limit of die optimized offer for one 
or more credit-card transacrions for as loi^ as die customer holds die credit card. 

Software Architecture for Optimization of Customer Relationship Management 

Figures 14-28 disclose an architecnirc for a software-based optimization and simulation system according 

25 to one embodfanent. The software architccttire may aUow die generation of decisions based on an objective, 
constraints, and uncertainty models as discussed widi refetence to Figures 3 du-ough 13. As discussed above, an 
objective is the target goal of a decision, a constraint is a qualifier for die objective, and an uncertainty model may 
include an expression of uncertainty regarding elements of the objective. In various -embodiments, the decisions 
may be made in an off-line, proactive manner wherein many decisions are made all togedier (e.g., a batch mediod), 

30 or in an on-line, reactive manner wherein one decision is made at a time. The software architecmre may solve die 
integration problems over die entire lifecycle of designing die decisions, making die decisions, and tracking die 
decisions. 

For example, a decision may comprise determining an optimal annual percentage rate -(APR) and credit 
line for each customer in a portfolio, wherein diat APR and credit line yield die noaximum lifetime customer value 
35 (LCV) widi a minimum net operating income (for die following year) of $15 nullion. The objective in diis decision 
is to maximize die lifetime customer value. TTus example optimization problem has one constraint: at least s 15 
miUion in net operating income for die following year. Furdiermore, Uiis example optimization problem has one 
risk factor or element of uncertainty: die cost of capital has die possibility of varying by ±10% over die next 5 
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years. Many oihcr examples could be made with lespeci to other marketing decisions, manufacmiing decisions, 
production decisions, and other suitable decisions. 

To make such a decision most effectively, a holistic system may be used that may include designing 
experiments, modeling from die experiments and historical data» making the optimized decisions, tracking the 
results from the experimcnts'dccisions, and embedding the experiments/decisions in on-line applications. One 
method of making the decision is in an off-line manner with a system that will make customer decisions in a batch 
manner. For cxan^le, this method might typically be used pioactively to change the APR and credit line for all 
customers in a portfolio. Another method is in an on-line manner with a system that makes the decision for one 
customer at a time. This manner might typically be used to react to a particular event, such as the <:ustomcr caUing 
to request a change. The software architecnirc disclosed herein comprehends both off-line and on-line mediods. 

Figure 14: Off-line System Architecture 

Figure 14 illustrates an off-line system architecmre for optimization of customer relaUonship management 
according to one embodiment Ih one embodiment, the architecmre not only supports the ability to make off-line 
decisions, but also supports perfonming simulations prior to deploying the off-line and on-line decisions. There arc 
four main sections to the architecmre: design of experiments, tracking, model building and decision making. The 
sections may be roughly identified using the modules surrounding the four data stores 2360. 2400. 2530, -2680. The 
design of experiments section includes the Experiment Database 2360 and the four modules connected to it: Import 
2100, Export 2150. Design Experiment 2300, and Experiment Engine 2340. The tracking section includes the 
Tracking Database 2400 and the Import Module 2100 coimected to it. The model-buUding section includes the 
Model Database 2530 and the two modules connected to it: Import 2100 and Build Components 2500. The 
decision-making section includes the Decision Database 2680 and the six modules connected to it: Import 2100. 
Export 2150, Assemble/Semp Components 2600. Decision Views 2660. Decision Engine 2640, and Decision 
Reports 2670. Various Import 2100 and Export 2150 modules may be coupled to External Data 2200. As shown in 
Figure 14. the off-line system architecmre may inchide Transformations 2120, Component Mathematical Models 
2510, and Segmentation and Sampling Rules 2330. 

The design of experiments section provides tools for creating and deploying experiments. The purpose of 
the experiments is to test various combinations of decision values (i.e,. the values of decision variables) in 
preparation for modehng the results. For example, in a credit card ic-pricing problem wherein the dccbion 
variables concern APR and credit line values for an account, an experiment may test combinations of APR and 
credit line values with current customers and prospecuvc customers. The results may then be used in the tools 
provided by the tracking and model-building sections of the architecture. 

The model-buUding section provides tools for creating and deploying mathematical models. As discussed 
above, diese models may be built from (e.g., trained on) historical data as well as previous experiments and 
decisions. Tlie mathematical models may encapsulate the data and results in a form that can be used to make future 
decisions. An example is a inathcmatical model calculating lifetime cusiorner value of a Such 
models may be used in the tools provided by the decision-making section. Results from the models may also be 
tracked via the tracking section. 
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The decision-making section provides tools for creating and deploying optimized decision answers. For 
example, a phannaccutical decision might include decision values concerning the number of dnig samples and 
client visits. The optimal decision may inchide fmding the right mix of samples and visits for the entire portfolio of 
clients, given budget consn^ints and risks related to unccirainiy of travel costs. Results from the decisions may be 
5 used in die tracking section. 

The tracking section provides tools for recording the results of the experiments deployed in the design of 
experiment section and the decisions deployed in the decision-making section. The results may then be used in the 
other sections to evaluate the perfonmance of die experiments, modcU. and decisions. The Tracking Database 2400 
may contain the experiment, model, and decision data that will be tracked. It may be organized by the projects diat 
10 were created in the design of experiments, model-building, and decision-making sections. The various projects may 
be linked to associate them with one another. Thus, in one embodiment, one is able to know if a model-building 
project relates to a decision-making project and a design-of-experiment project Furthemaorc, a given project might 
be associated with another project. For example, a given design-of-cxperiment project might be derived from 
another dcsign-of-cxpcrimcnt project. Data may be put into the Tracking Database 2400 when a project is 
15 deployed. Deploying a projcci^s experiment via the Export module 2150 may cause the experiment's data to be 
saved to the Tracking Database 2400. In one embodiment, each section has a sub-module that includes tools that 
use the Tracking Database 2400. 

It is also conceived that these modules can be packaged in many forms. For example, they could be 
packaged as a desktop software product, as a client-server software product thai supports multiple users, or as a web 
20 software product. 

Figure 15: Import Module 

Figure 15 illustrates the sub-modules of an Import module 2100 for optimization of customer relationship 
management according to one cmbodimem. The Import module 2100 may be used to load data into the various 

25 system databases. The Data Transformation Engine sub-module 21 10 converts the data received from an external 
database or system to a usable form for the various tools using die system databases. Visualization Tool sub- 
modules 2140 may cooperate with the Data Transformation Engine sub-module 21 10 to view die data and statistics 
of the data and build the transformations with those views. Example Visualization Tools 2 140 arc XV plots, row 
number plots, histogram plots, cortelation plots, probability plots, PCA plots, and other suitable tools. The 

30 transformations can be built using the views and/or using an editor to explicitly express the transfom:iations in terms 
of the data. In one embodiment, die Import module 2100 is extensible to add and remove Visualization Tool sub- 
modules 2 140. The transformations can be saved in a reusable form 2120. 

One potential reuse of the transformations is in an on-line applk;ation (as shown in Figure 27). wherein the 
transformations 2120 may be used to automatically transform the data from the on-line application. The application 

35 may use the Data Transformation Engine sub-module 21 10 to transform the application data. The Insert nnodule 
2100 may also contain Data Interface sub-modules 2130 for interfacmg to the various system databases 2360, 2400, 
2530, 2680 and to the various external databases and systems 2200. In one embodiment, die Import module-2100 is 
extensible to add and remove Data Interface sub-modules 2130. 
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Figure 1 6: Export Module 

Figure 1 6. illustrates the sub-module$ of an Export module 2 150 for opdznization of customer relationship 
management according to one embodiment The Export module 2150 may be used to unload data from the various 
system databases. The Data Transformation Engine sub-module 21 10 converts the data contained in die system 
5 databases to a usable form for the various external systems and databases. The same Data Transformation Engine 
sub-module 21 10 may be used for the Export 2150 and Import 2100 modules. The Export modules 2150 contain 
Visualization Tool sub-modules that cooperate with the Data Transformation Engine sub-module 21 10 to build the 
transformations. In one embodiment, the Export module 2150 is extensible to add and remove Visualization Tool 
sub-modules. The Visualization Tool sub-modules 2140 used in the Export module 2150 may or may not be die 
10 same as those used in the Impon module 2100. In one embodiment, however, all Visualization Tool sub-modules 
2140 support the same interface to be used in either. The transformations built can be saved in a re-usable form 
2120. 

One potential reuse of the transformations is in an on-line application (as shown in Figure 27). wherein the 
transformations 2 120 may be used to automatically transform the data from the on-line application. The application 
1 S may use the Data Transformation Engine sub-module 21 10 to transform the data in the Experiment Database '2360. 
The Export module 2150 also contains DaU interface sub-modules 2130 for interfacing to the various system 
databases 2360, 2400. 2530. 2680 and the various external databases and systems 2200. In one embodiment, the 
Export module 2150 is extensible to add and remove Data Interface sub-modules 2130. The Import 2100 and 
Export 2 1 50 modules may share some of the same Data Interface sub-modules 2130. 

20 

Figure 17: Design Experiment Module 

Figure 1 7 illustrates the sub-modules of the Design Experiment module 2300 for optimizanon of customer 
relationship management according to one embodiment. The Design Experiment module 2300 may be used to 
create, delete, edit, view, and track the experiments. The Design Experiment module 2300 includes visualization 

25 tools that work with the Experiment Database 2360 and Experiment Engine^340 to create, delete, -edit, and view 
die experiments. The Create Tool sub-module 23 10 creates experiments for a project. The.Delete Tool sub-module 
2315 deletes experiments of a project. The Edit Tool sub-modules 2305 manage the segmentation and -sampling 
rules 2330 used by the Experiment Engine 2340. The View Tool sub-modules 2320 include various visualizations 
of the experiments, including reports and charts showing the data after the segmentation and sampling rules are 

30 applied. The Track Tool sub-modules 2325 include reports arul charts comparing the results of executing the 
experiment to what was designed. In one embodiment, the Design Experiment module 2300 is extensible to add 
and remove Edit Tool 2305. View Tool 2320, and Track Tool 2325 sub-modules. The Design Experiment modules 
also includes functionality to manage the projects that contain the experiments. 

35 Figure 18: Experiment Engine Module 

Figure 18 illustrates the sub-modules of the Experiment Engine module 2340 for optimization of customer 
relationship management according to one embodiment The Experiment engine module 2340 may be used to 
apply the segmentation and sampling mles 2330 against the transformed data in the Experiment Database 2360. 
The Segment Engine sub-module 2350 may encapsulate a segmentation algorithm and perform that algorithm 
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according to ihc segmentation rules created in the Design Experiment module 2300. The segmentation rules may 
be specific to the segmentation algorithm. Segmentation algorithms may comprise simple cut rules to conylicaied 
clustering algorithms. The Sample Engine sub-module 2350 may encapsulate a sampling algorithm and perfonm 
that algorithm according to the sampling nilcs created in the Design Experiment module 2300. The sampling rules 
5 may be specific to the sampling algorithm. Sampling algorithms may include a variety of algorithms, from simple 
and random to complicated and score-based algorithms. In one embodiment, the Experiment Engine module 2340 
is extensible to add and remove Segment Engine 2350 and Sample Engine 2345 sub-modules. 

Figure 19: Build Components Module 

10 Figure 19 illusn-atcs ihe sub-modules of the Build Components module 2500 for opiimizalion of^rustomcr 

relationship managemeni according to one embodiment. The Build Components module 2500 may be used to build 
component mathematical models 2510 for use in the decision-making section. The component models may be of 
various types, such as neural network, logistic regression, linear regression, genetic algorithm, table lookup, and 
other suitable models. Projects may be created in the Build Components module 2500 to encapsulate the work for 

15 one or more component models. Each type of component model may have its own set of Edit Tools 2505, Analysis 
Tools 2515. and Track Tools 2520. The Edit Tools provide mechanisms for creating and editing component 
instances of the corresponding type of model. For example, an Edit Tool 2505 for a neural network -component 
might identify data elements in the Model Database 2530 as inputs and outputs for the neural neiworic and then train 
the neural network on the corresponding data. The Analysis Tools 2515 may provide mechanisms for analyzing 

20 and viewing the component models. For example, an Analysis Tool 2515 for a neural network might identify the 
sensitivities of the inputs to outputs. Another Analysis Tool 2515 for a neural network might show the internal 
layers with their corresponding weights. The Track Tools 2520 may provide mechanisms for comparing results 
from deploying the con^nent models. For example, a Track Tool 2520 for a neural network wouW show 
predicted versus actual values for the outputs. In one embodiment, the Build Components module 5500 is 

25 extensible to add and remove Edit Tool 2505, Analysis Tool 25 15, and Track Tool 2520 sub-modules. 

Figure 20: Assemble/Setup Components Module 

Figure 20 illusn^tes the sub-modules of the Assemblc/Scmp Conq)onents module 2600 for optimization of 
customer relationship management according to one embodiment. The Assemble/Setup Components module »2600 

30 may be used to perform setup steps required prior to performing the optimization and simulation. Projects are 
created in the Assemble/Senip Components module 2600 to encapsulate the configuration work for one or more 
configuration variations. A configuration variation is encapsulated m an abstraction called a question. Questions 
may reference objectives managed by die Assemble Objective 2610 sub-module, risk variables managed by the Edit 
Risk 2615 sub-module, and segments managed by die Edit Segments 2620 sub-module. The Assemble Objective 

35 sub-module 2610 may be used to assemble con^ionent mathematical models 2510 into objectives for a project. 
Assembling may include binding component outputs to component inputs. Assembling may also include binding 
componem inputs and outputs to data elements in the Decision Database 2690. The project can contain many 
objectives. Questions reference the project's objectives as desired by the user. 
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The Edit Risk sub-module 2615 may be used lo create and^it the set of risk variables for a project. Risk 
variables are selected from the set of component inputs, component outputs, and Decision Database 2680 data 
elements. Risk variables may have properties of high and low value. Tlic high and low values are expressed in 
relation to the actual value, such as a percentage difference, absolute value, -etc. Questions reference ihe project's 
5 risk variables as desired by the user. The Edit Segments sub-module 2620 may be used to define the segmentation 
to be used for reporting and question solving. The segmentation may be defmed according to dimensions, 
attributes, elements, and facts, which are concepts defined in Muhi-Dimcnsional Databases. In addition, the Data 
Transformation Engine sub-module 2110 may be used in the Edit Segments sub-module 2620 to define 
transformations 2120 that build facts for the segmentation. These facts form the decision-level records to be used 
1 0 when solving the questions. 

Figure 2 1 : Manage Questions Sub-module 

Figure 21 illustrates a hierarchy of the Manage Questions sub-module 2605 for optimization of customer 
relationship management according to one embodiment. In one embodiment, questions may be of two base types: 

15 optimization and prediction. An optimization question solves for a set of input variables in an objective. A 
prediction question calculates an objective. There may aUo be derivations of these two base types. For example, 
marginal optimization includes an additional objective called the baseline to compare against. In one embodiment, 
all questions have basic fiinctionality provided by the Manage Questions sub-module 2605. This functionality 
includes creating, copying, and deleting questions. The functionality also includes sclectii^ from the project an 

20 objective, the risk variables, and the segmentation clemeni(s) to use for solving the question. The Manage 
Prediction sub-module 2606 adds the fiinctionality of selecting additional objectives. The Manage Optimization 
2607 and Manage Marginal Optimization 2608 sub-modules are discussed below. 

Figure 22: Manage Optimization Sub-module 

25 Figure 22 ilhistrates the sub-modules of die Manage Optimization sub-module 2607 for opdmization of 

customer rel«ionship management according to one embodiment. The Manage Optimization sub-module 2607 
may add functionality for managing decision variables, constraints, and reason codes to the Manage Questions sub- 
module 2605. The Edit Decision Variable sub-module 2625 may be used to create and edit ihc set of decision 
variables for a project Decision variables have properties related to dieir values, and the properties are specific to 

30 the type of variable. In one embodiment, two types of decision variables may be used: discrete and continuous. 
Discrete variables have properties describing the possible values. These values can be -expressed, for example, as a 
minimum value, maximum value, and incremenr, or they can be expressed as a set of discrete values. Continuous 
variables have properties of minimum and maximum value. The Manage Optimization sub-module 2607 manages 
the subset of project's decision variables to solve for in a question. The Manage Optimization sub-module -2607 

35 also manages the allowable decision variable value combinations for the question. 

The Edit Constraints sub-module 2630 may be used to create and edit die optimization constraints Tor a 
project. Constraints are expressed using terms that include data constants, data elements in the Decision Database 
2680. expressions containing data elements, and/or data constants. The consoraint expression may include diree 
parts: a left-hand term, a relational operator, and a right-hand temtL Relational operators are the typical numeric 



31 



wo 01/55939 PCT/USOl/02880 
reladoxui) operators such as equal, less than, greater than, etc. Constraints can be -global, regional, or local. As 
discussed above, global and regional constraints are constraints where the terms used rolled-up focts from the 
segmentation. For exan^le, a global constraint could be total net operating income over the entire portfolio greater 
than SIS million; and a regional constraint could be total mail costs in the southwest less than $1 million. Local 
5 constraints are constraints where the terms use facts from the decision-level records. For example, a local constraint 
could be number of mailings greater than 0. The Manage Questions sub-module 2605 manages the subset of a 
project *s constraints to use in solving the question. 

The Edit Reasons sub-inodule 2635 may be used to create and edit the rules for generating reason codes 
associated with the solved decision variables. The rules are expressions that if true, produce a reason code. The 
10 expressions are built using terms that may include data constants, dau elements in the Decision Database 2680, 
and/or results of calculations on those data elements. The terms may be put together as relational and logical 
expressions. For example, such expressions may include "BchaviorScore < 600" and "CurrcntCL > NewCL**. 

Figure 23: Manage Marginal Optimization Sub-module 

15 Figure 23 illustrates the sub-modules of the Manage Marginal Optimization sub-module 3608 for 

optimization of customer relationship management according to one embodiment. The Manage Marginal 
Optimization sub-module 2608 may add the functionality of managing a baseline objective to the Manage 
Optimization sub-module 2608. The Manage Baseline sub-module 2636 identifies the objective from the project's 
list of objectives and initiates die calculation of Ac baseline objective for the decision records. A baseline objective 

-20 is of the same structure as the optimization objective, except the behavioral components of the objective represent 
the normal business behavior. For example, if the optimization objective is lifetime customer value, the baseline 
objective is also lifetime customer value. And, die difTcrcncc between the two is the set of -components assembled 
into each. 

25 Figure 24: Decision Engine Module 

Figure 24 illustrates die sub-modules of the Decision Engine nK)dule 2640 for optimization of customer 
relationship management according to one embodiment The Decision Engine module 2640 may be used to 
perform the calculations for a question. The Calculation Engine sub-module 2645 may be used to calculate the 
objective, constraints, and any miscellaneous equations for a decision level record. The objective, constraints, and 

30 miscellaneous equations may be created in the Assemble/Setup Components module -2600 by assembling 
conq)onent5. A decision-level record is either formed via the segmentation traBsfoxmations in die Edit Segments 
sub-module 2635 or assumes the account-level records brought into the Decision Database 2680. An account-level 
record represents the data elements for a customer or some entity that is the focus of the decision. 

The Decision Engine module 2640 may be configured with multiple Calculation Engine sul>.moduies2645 

35 depending on the configuration of the Question Engine sub-module 2650. The Question Engine sub-module 2650 
performs the algorithm specific to a question. If the question is configured to perform an optimiza^tion, the Question 
Engine 2650 may inchide that optimization algorithm. If the question is configured to perform a prediction, the 
Question Engine 2650 may include diat prediction algorithm.. For example, if the question is configured to perform 
an optimization of discrete decision variables widi global constraints and risk variables, then a Question Engine 
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2650 with tot ability is used. In one embodiment, die Decision Engine module 2640 is extensible to add and 
remove Quesdon Engine sub-modules 2650. It is also conceived die Decision Engine module 2640 could be built 
to run calculations in paraDel or in a distributed manner. For example. die<}uestion Engine sub-module 2650 could 
invoke multiple Calculation Engine sub-modules 2645 in parallel or across a network (in a distributed manner). 

5 

Figure 25: Decision Views Module 

Figure 25 illustrates the sub-modules of the Decision Views module 2660 for optimization of customer 
relationship management accoiding to one embodiment The Decision Views module 2660 may be used to perform 
minor semp changes to a question, to start die calculations, and to view die results of die calculations. Minor senip 

10 changes include selecting the segment over which the calculations are nm and selecting die risk variables. Access 
may also be provided to die setup functionality in die Assemble/Setup Componenis module 2600. which allows 
more major changes. Once die setup changes have been made, a mechanism is provided to start the calculations, 
which will be run by die Decision Engine module 2640. After die calculations have been nin, various tables and 
charts are used to evaluate die decisions. The tables and charts are encapsulated via a View sub-module 2665. In 

1 5 one embodiment, die tables and charts have direct access to die results of die Decision Engine 2640, including 
deutils diat might not be stored persistently in die DecUion Database 2680. The View sub-modules 2665 may allow 
one to compare die scenario simulations generated from die risk variables and look at die robustness of die 
decisions across diose scenarios: Access may also be provided to die reports 2675 in die Decision Reports modules 
2670. In one embodiment, die Decision Views module 2660 is extensible to add and remove View sub-modules 

20 2665. 



Figure 26: Decision Reports Module 

Figure 26 illustrates the sub-modules of die Decision Reports module 2670 for optimaation of customer 
relationship management according to one embodiment. Tbc Decision Reports module 2670 may be used to 

25 examine die results of a project's question from die Decision Database 2680. The results may be shown as rqwrts 
via Report sub-modules 2675. These reports may take many forms, including web pages. In one embodiment, all 
reports may show the results widiin die segmentation. The results shown may include die decision mix. die 
constraint adherence, die objective values, intermediate calculations, and question configuration information. There 
may also be provided comparison reports diat compare any of die results between projects and between questions. 

30 There may also be provided tracking reports showing die actoal results versus die predicted results. The tracking 
reports woric off die Tracking Database 2400. In one embodiment, die Decision Reports module 2670 is «tcnsible 
to add and remove Report sub-modules 2675. 

Figures 27 and 28: On line Architecture 
35 In one embodiment, die system architecture for on-line, reactive decbions may be a modification of die 

off-line system architccmre. On-line applications are usually buik to serve oflicr purposes dian making decisions. 
Therefore, die process of making a decision needs to be embedded in diose on-line applications, figure 27 shows 
die system architecnirc for embedding die experiment process according to one embodiment. Figure 28 shows die 
system architecnire for embedding die decision process according to one embodiment. To en^ed die experiment 
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and decision processes, the application programming interfaces (APk) for the Data Transformation Engine sub- 
module 2110, the Experiment Engine module 2340, and the Decision Engine module 2640 may be provided to the 
programmer of the on-line application. 

Figure 27 illustrates an on-line experiment architecture for optimization of customer relationship 
5 management according to one embodiment. To embed the experiment process, the on-line application may be 
modified to use die APIs for the Data Transfomnation Engine sub-module 2 1 10 and the Experiment Engine module 
2340. The transformations 2120 and roles 2330 arc built with the modules of the off-line system architecnirc (sec 
Figure 14). Once built and tested via simulations, they may be deployed to the on-line application. The Experiment 
Database 2360 may be implemented as an in-memory database. In one embodiment, it is only required to hold die 

1 0 data elements for one customer or entity. 

Figure 28 illustrates an on-line decision architecmre for optimization of customer relationship management 
according to one embodimen!. To embed the decision process, the on-line application may be modified to use die 
APIs for die Data Transformation Engine sub-module 2110 and die Decision Engine module 2640. The 
transformations 2120 and component models 2510 arc built with the modules of the ofT-line system architecture 

15 {see Figure 14). Once built and tested via simulations, diey may be deployed to the on-line application. If the 
decision docs not include global or regional constraints, die Decision Database -2680 may be implemented as an in- 
memory database, since it is only required to hold the data elements for one customer or entity. However, widi 
global or regional constraints, die Decision Database 2680 holds the data elements for all customers or^ntities to 
which die constraints apply . 

20 Various embodiments may further include receiving or storing instructions and/or data in^lemented in 

accordance widi die foregoing description upon a carrier medium. Suitable carrier media may include storage 
media or memory media such as magnetic or optical media, e.g., disk or CD-ROM, as well as signals such as 
electrical, electromagnetic, or digital signals, conveyed via a communication medium such as networks 102 and/or 
1 04 and/or a wireless link. 

25 Although die system and mediod of die present invention have been described in connection with several 

embodiments, die invention is not intended to be limited to die specific forms set fonh herein, bur on die contrary, it 
is intended to cover such alternatives, modifications, and equivalents as can be reasonably included widiin the spirit 
and scope of the invention as defmed by the appended claims. 
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What is claimed is: 
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1. A method for selecting an oplimal course of action for marketing products to a plurality of 
customers, the method comprising: 

inputting customer data records into one or more predictive models lo^eneraie one or more action 
variables, wherein the action variables comprise predictive customer behaviors 
corresponding to the customer data records; 

inputting an objective function and one or more constraints into an optimizer, wherein the 
constraints comprise limitations on one or more resources, and wherein the objective 
function and the constraints comprise a function of the acUon variables across a plurality' 
of uncertainty models; 

the optimizer solving the objective function subject to the constraints to select an optimal course 
of action across the plurality of uncertainty models for marketing products to a pluralit>^ 
of customers. 

2. The method of any of the preceding claims, further comprising: 

a user selecting the uncertainty models according to managerial judgment. 

3. The method of claim 2. 

wherein the user selecting the uncertainty models according to managerial judgment fuither 
comprises the user selecting a prior distribution. 

4. The method of any of the preceding claims, furAcr coii^jrising: 

generating the plurality of uncertainty models by sampling a probability distribution to represent 
varying circumstances of possible futures. 

5. The method of any of the preceding cbims, 
wherein the uncertainty models comprise scenarios. 

6. The method of claim 5, further comprising: 

assigning a weight to each of the scenarios to denote its likelihood of occurrence. 

7. The method of any of the preceding claims, 

wherein the uncertainty models are implemented by a neural network. 

8. The method of any of the preceding claims, 

wherein the uncertainly models comprise one or more averaged models and a residual model. 
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9. 



The method of claim 8, further comprisicg: 

training a neural network to represent the averaged models. 
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] 0. The method of any of the preceding claims, 
5 wherein solving the objective function subject to the constraints to select the optimal course of 

action across the plurality of uncertainty models further comprises solving the objective 
function to avoid a worst case scenario. 

1 1 . The method of any of the preceding claims. 

10 wherein solving the objective function subject to the constraints to select the optinial course of 

action across the plurality of uncertainty models further comprises solving the objective 
function according to a desired level of risk. 

1 2. The method of any of the preceding claims, further comprisii^: 

15 marketing the products to the plurality of customers in accordance with the optimal course of 

action. 

13. The method of any of the preceding claims, further comprisiiig: 

applying the optimal course of action to one or more customer relationships to increase the value 
20 of the customer relationships. 

14. Themethodof any of the preceding claims. 

wherein each customer data record corresponds to an individual customer. 

25 IS. The method of any of the preceding claims, 

wherein each customer data record corresponds to a segment, wherein the segment comprises a 
plurality of customers. 

16. The method of any of the preceding claims. 

30 wherein each customer data record corresponds to a sample of a plurality of customers. 

17. The method ofany of the preceding claims, 

wherein the predictive models comprise a neural network. 

35 IS. The method of any of the preceding claims, further comprising: 

training the neural network as a function of historical data records. 
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19. The method of any of ihc preceding claims, 

wherein the optimizer solving the objective function further comprises solving the objective 
function via linear programming. 

20. The method of any of the preceding claims, 

wherein ihc optimizer solving the objective function further comprises solving the objective 
function via non*linear programming. 

2 1 . The method of any of the preceding claims, 

wherein the objective function is a cross-record objective function. 

22. The method of any of the preceding claims, further comprising: 

inputting one or more cross-record constraints into the optimizer, wherein the cross-record 
constraints comprise limitations on one or more global resources; 

and wherein the optimizer solving the objective function further comprises the optimizer solving 
the objective function subject to the cross-record constraints. 

23. The method of any of the preceding claims, 

wherein the objective function further comprises a lunction of lifetime customer value. 

24. The method of claim 23, 

wherein Kfetime customer value comprises a sum of discounted cash flows over the lifetime of a 
customer relatiooship. 



25. A system comprising: 

one or more predictive models operable to generate one or more action variables from a plurality 
of customer data records, wherein the action variables comprise predictive customer 
behaviors corresponding to the customer data records; and 

an optimizer coupled to the predictive models, wherein the optimizer is operable to receive an 
objective function and one or more constraints, wherein the constraints comprise 
limitations on one or more resources, wherein the objective function and die constraints 
comprise a function of the action variables across a plurality of uncertainty models, and 
wherein the optimizer is operable to solve the objective function subject to the 
constraints to select an optimal course of action across the plurality of uncertainty 
models for marketing products to a plurality of customers; 

wherein the system is operable to perform the method of any of claims 1 through 24. 

26. A carrier mediiun comprising program instmctions which are computer-executable to implement 
the method of any of claims 1 through 24. 
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27. A method comprising: 

inputting data records into one or moie predictive models lo generate one or mow action 
variables; 

inpuning an objcciivc function and one or more constraints into an optimizer, wherein the 
constraints comprise limitations on one or more resources, and wherein the abjective 
function and the constraints comprise a function of the action variables across a plurality 
0 f uncertainty models; 

the optimizer solving the objective function subject to the constraints to select an optimal course 
of action across the plurality of uncertainty models. 

28. A method for determining an optimal course of action for marketing one or more products to a 
plurality of customers, the method comprising: 

inpuning customer data records into one or more predictive models tO;generate one or more action 
variables* wherein the action variables comprise predictive customer behaviors 
corresponding to the customer data records; 

inputting an objective function and one or more constraints into the optimizer, wherein the 
objective function comprises a function of the action variables, wherein the constraints 
comprise limitations on one or more resources, and wherein the objective function 
further comprises a function of lifetime customer value; 

die optimizer solving the objective function subject to die constraints to seica an optimal course 
of action for marketing one or more products to a plurality of customers. 

29. A method for selecting an optimal course of action for marketing one or more products to a 
plurality of customers, the method comprising: . 

inputting customer data records into one or more predictive models to generate one or more action 

variables, wherein the action variables coniprisc predictive customer behaviors 

corresponding to the customer data records; 
inputting an objective function and one or more constraints into an optimizer, wherein the 

objective function comprises a function of the action variables, and wherein the 

constraints comprise limitations on one or more resources; 
the optimizer solving the objective function subject to limitations on one or more global resources 

to select an optimal course of action for marketing one or more products to a plurality of 

customers. 

30. A method for managing customer relationships, the method comprising: 
collecting a set of customer data corresponding to one or more customers; 

optimizing one or more decision variables based on an objective and one or more constraints for 
the set of customer data to produce optimized decision variables for a product offer; 
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sening one or more tenns of a product co the optimized decision variables to produce an 

optimized product, wherein the optimized product comprises a set of optimized terms; 
offering the optimized product to one or more of the customers; 
accepting a response from the customer to the ofTering; 
. carrying out the optimized leiros during a lifetime of the optimized product. 
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